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Abstract: This paper presents an adaptive fault-tolerant control (FTC) scheme for a class 
of nonlinear uncertain multi-agent systems. A local FTC scheme is designed for each agent 
using local measurements and suitable information exchanged between neighboring agents. Each 
local FTC scheme consists of a fault diagnosis module and a reconfigurable controller module 
comprised of a baseline controller and two adaptive fault-tolerant controllers activated after 
fault detection and after fault isolation, respectively. Under certain assumptions, the closed- 
loop system’s stability and leader-follower consensus properties are rigorously established under 
different modes of behavior of the FTC system, including the time-period before possible fault 
detection, between fault detection and possible isolation, and after fault isolation. 


Keywords: Fault-tolerant control. Multi-agent systems. Consensus 


1. INTRODUCTION 

Several modern technical systems can be characterized 
by distributed multi-agent systems, that is, systems 
comprised of various distributed and interconnected au¬ 
tonomous agents/subsystems. Examples of such systems 
include cooperative unmanned vehicles, smart grids, air 
traffic control system, etc. In recent years, cooperative con¬ 
trol using distributed consensus algorithms has received 
significant attention (see, e.g., Ren and Beard (2008)). 
Since the overall distributed multi-agent systems are re¬ 
quired to operate reliably at all times, despite the possible 
occurrence of faulty behaviors in some agents, the devel¬ 
opment of fault diagnosis and accommodation schemes is 
a crucial step in achieving reliable and safe operations. 

In the last two decades, signihcant research progress has 
been made in the design and analysis of fault diagnosis 
and accommodation schemes (see, for instance, Blanke 
et al. (2006)). Most of these methods utilize a centralized 
architecture, where the diagnostic module is designed 
based on a global mathematical model of the overall 
system and is required to have real-time access to all sensor 
measurements. Because of limitations of computational 
resource and communication overhead, such centralized 
methods may not be suitable for large-scale distributed 
interconnected systems. As a result, in recent years, there 
has been a signihcantly increasing research interest in 
distributed fault diagnosis schemes for multi-agent systems 
(see, for instance, Yan and Edwards (2008); Ferrari et al. 
(2012); Shames et al. (2011)). 

This paper presents a distributed adaptive FTC method¬ 
ology for accommodating faults in a class of nonlinear un¬ 


certain multi-agent systems. A FTC scheme is designed for 
each agent in the distributed system by utilizing local mea¬ 
surements and suitable information exchanged between 
neighboring agents. Each local FTC scheme consists of 
two main modules: 1) the online health monitoring (fault 
diagnosis) module consists of a bank of nonlinear adaptive 
estimators. One of them is the fault detection estimator, 
while the others are fault isolation estimators; and 2) the 
reconfigurable controller (fault accommodation) module 
consists of a baseline controller and two adaptive fault- 
tolerant controllers used after fault detection and after 
fault isolation, respectively. Under certain assumptions, 
the closed-loop system’s stability and leader-following con¬ 
sensus properties are established for the baseline controller 
and adaptive fault-tolerant controllers. This paper signifi¬ 
cantly extends the results of (Zhang et al. (2004)) by gen¬ 
eralizing the centralized FTC method to the case of leader- 
follower formation of distributed multi-agent systems. 

2. GRAPH THEORY NOTATION 

A directed graph ^ is a pair (V, £), where V = {ui, • • • , up} 
is a set of nodes, £ C V x V is a set of edges, and 
P is the number of nodes. An edge is an ordered pair 
of distinct nodes {vj,Vi) meaning that the ith node can 
receive information from jth node. Eor an edge {vj,Vi), 
node Vj is called the parent node, node Vi the child node, 
and Vj is a neighbor of up An undirected graph can be 
considered as a special case of a directed graph where 
{vi,Vj) G £ implies {vj,Vi) G £ for any Vi,Vj G V. An 
undirected graph is connected if there is a path between 
any pair of nodes. A directed graph contains a directed 
spanning tree if there exists a node called the root such 



that the node has directed paths to all other nodes in the 
graph. 

The set of neighbors of node Vi is denoted by Ni = {j : 
(vjjVi) G E}. The weighted adjacency matrix A = [a^] G 
associated with the directed graph Q is defined by 
an = 0, aij > 0 if (vj,Vi) G E, and aij = 0 otherwise. 
The topology of an intercommunication graph Q is said 
to be fixed, if each node has a fixed neighbor set and 
is fixed. It is clear that for undirected graphs atj = aji. 
The Laplacian matrix L = [kj] € 3?^^^ is defined as 
hi = hj = —ciij, i ^ j. Both A and L 

are symmetric for undirected graphs and L is positive 
semidefinite. 


3. PROBLEM FORMULATION 

Consider a set of M agents with the dynamics of the ith 
agent, t = 1, • • • , M, being described by 


Xi = (j)i{xi) AUi{xi,xj)+ri^{xi,t) ('I'l 

+Pi{t-Ti)fi{xi,Ui{xi,xj)), ^ 

where Xi G 3?” and Ui G 3?” are the state vector and 
input vector of the ith agent, respectively. Additionally, 
xj contains the state variables of neighboring agents that 
directly communicate with agent i, including the time- 
varying leader to be tracked (i.e., x’’) as agent number 
M + 1, i.e., J = {j -.j G 7VJ, 0, : 3?" ^ 3?”, 77 , : 3?" x 
3?+ !-)■ 3?” and fi : 3?” x 3?” !->■ 3?” are smooth vector fields. 
Specifically, (pi and r]i represent the known nonlinearity 
and modeling uncertainty, respectively. The term f3i{t — 
Ti)fi{xi,Ui) denotes the changes in the dynamics of ith 
agent due to the occurrence of a fault. Specifically, /3i(t — 
Ti) represents the time profile of a fault which occurs 
at some unknown time Ti , and fi(xi,Ui) is a nonlinear 
fault function. In this paper, /3i(-) is assumed to be a step 
function (i.e., Pi{t — T^) = 0 if t < Ti, and j3i{t — Ti) = 1 
if t > Ti). It is assumed that in each agent only one fault 
possibly occurs at any time. 

Remark 1: The distributed multi-agent system model 
given by (1) is a nonlinear generalization of the single inte¬ 
grator dynamics considered in literature (for instance, Ren 
and Beard (2008)). In this paper, in order to investigate 
the fault-tolerance and robustness properties, the fault 
function fi{xi) and modeling uncertainty rji are included 
in the system model. 


For isolation purposes, we assume that there are Xi types 
of possible nonlinear fault functions in the fault class as¬ 
sociated with the tth agent; specifically, fi{xi,Ui) belongs 
to a finite set of functions given by 

= {flixijUi),--- ,fpixi,u^)}. ( 2 ) 

Each fault function //, s = 1, • • • , r^, is described by 


fp{xi,Ui) = [(6'®i)"5®i(a;i,Mi)r-- , (fi'm) (3) 


where for z = 1, • • • , M, and p = 1, • • • , n, is an un¬ 
known parameter assumed to belong to a known compact 
set 0fp (i.e., Ofp G C 3?^*p), and : 3?” x 3?” is 

a known smooth vector field. As described in Zhang et al. 
(2004), the fault model described by (2) and (3) charac¬ 
terizes a general class of nonlinear faults where the vector 
field gfp represents the functional structure of the sth 
fault affecting the pth state equation, while the unknown 
parameter vector 0® characterizes the fault magnitude. 


The objective of this paper is to develop a robust dis¬ 
tributed fault-tolerant leader-following consensus control 
scheme, using diagnostic information, for the class of dis¬ 
tributed multi-agent systems described by (1). The follow¬ 
ing assumptions are made throughout the paper: 

Assumption 1. Each component of the modeling uncer¬ 
tainty, represented by r]i{xi,t) in (1), has a known upper 
bound, i.e., Vp = 1, • • • ,n, Wxi G 3ft" and Vzti G 3ft", 

\r]ipixi,t)\ < fj^p{xi,t), (4) 

where the bounding function fjip is known and uniformly 
bounded. 

Assumption 2. The intercommunication topology of the 
distributed system described by (1) is a fixed connected 
undirected graph. 


Assumption 1 characterizes the class of modeling uncer¬ 
tainty under consideration. The bound on the modeling 
uncertainty is needed in order to distinguish between the 
effects of faults and modeling uncertainty during the fault 
diagnosis process. Assumption 2 is needed to ensure that 
the information exchange among agents is sufficient for the 
team to achieve the desired team goal. 


Let us define three important time-instants: Ti is the fault 
occurrence time; Td > Ti is the time-instant when a 
fault is detected; Tisoi > Td is the time-instant when 
the monitoring system (possibly) provides a fault isolation 
decision, that is, which fault in the class T) has actually 
occurred. The structure of the fault-tolerant controller for 
the zth agent takes on the following general form (Zhang 
et al. (2004)): 


( goiuJi,Xi,xj,t), for t < Td 
= < gDiuJi,Xi,Xj,t) , for Td < t < Tisoi 
[ gi{uJi,Xi,xj,t), for t > Tjsoi 

( hoiu!i,Xi,xj,t), for t<Td 

Ui = < hD{uJt,x^,xj,t ), for Td < t < Tjsoi 
[ hi{uji,xi,xj,t), for t > Tisoi 


( 5 ) 


where oji is the state vector of the distributed controller; 
9oigDi9i and hQ,h£,,hi are nonlinear functions to be 
designed according to the following qualitative objectives: 


(1) In a fault free mode of operation, a baseline controller 
guarantees the state of zth agent Xi{t) should track 
the leader’s time-varying state x'", even in the possible 
presence of plant modeling uncertainty. 

(2) If a fault is detected by diagnostic scheme, the base¬ 
line controller is reconfigured to compensate for the 
effect of the (yet unknown) fault, that is, the fault- 
tolerant controller is designed in such a way as to ex¬ 
ploit the information that a fault has occurred, so that 
the controller may recover some control performance. 
This new controller should guarantee the bounded¬ 
ness of system signals and some leader-following con¬ 
sensus performance, even in the presence of the fault. 

(3) If the fault is isolated by diagnostic scheme, then 
the controller is reconfigured again. The second fault- 
tolerant controller is designed using the information 
about the type of fault that has actually occurred so 
as to improve the control performance. 


4. BASELINE CONTROLLER DESIGN 


In this section, we design the baseline controller and in¬ 
vestigate the closed-loop system stability and performance 
before fault occurrence. Without loss of generality, let 
the leader be agent number M -|- 1 with a time-varying 
reference state (i.e., xm+i = x’’). The baseline controller 
for the zth agent can be designed as: 



^ ^ kijXij (j^ipixip) Kip sgTi(^ ^ ^ kijXij^^ (6) 
ieWi ieWi 

where Uip and Xip are the pth component of the input and 
state vectors of the zth agent, respectively, p = 1, • • • ,n, 

% — 1, * * • , Ad , Xij — Xip Xjp , Kip — gip Kp , Kp is a 
positive bound on |ip| (i.e., Kp > |ip|), sgn{-) is the sign 
function, Ni is the set of neighboring agents that directly 
communicate with the zth agent including the leader, and 
kij, for j € Ni, are positive constants. Notice that kim = 0, 
for m ^ Ni- 

Note that, by considering the leader as agent M + 1, the 
topology graph for the M + 1 agents has a spanning tree 
with the leader as its root. First, we need the following 
Lemmas: 

Lemma 1. (Ren and Beard (2008)) The Laplacian matrix 
L e of a directed graph Q has at least one 0 

eigenvalue with Ip as its right eigenvector, where Ip is 
a P X 1 column vector of ones, and all nonzero eigenvalues 
of L have positive real parts. 0 is a simple eigenvalue of L 
if and only if the directed graph Q has a spanning tree. 

Lemma 2. Consider a connected graph Q with the leader 
as the (M + l)th node. The matrix 

C = 'i>C + C^'i> (7) 

is positive semidefinite and has a simple zero eigen¬ 
value with 1 m+i as its right eigenvector, where dz € 
s)fj(M+i)x(M-i-i) jg Laplacian matrix of the graph with 
an undirected leader, and C € is the Lapla¬ 

cian matrix of the graph with a directed leader. 

Proof. Decomposing the Laplacian matrices £ and dz, we 
have 


Til Ti2 

OixM Oixi 


d- = 


Tii Ti2 
£i2 T 22 


( 8 ) 


where in € is a symmetric matrix, P 12 € 

and L 22 € 3?. Based on Lemma 1, the matrix P is a positive 
semidefinite matrix having a simple zero eigenvalue with 
1m-i-i as its right eigenvector. Therefore, the specific 
structure of £ defined in (8) implies that Ln is a positive 
definite matrix, having all its eigenvalues in the right-hand 
plane. From (8), we obtain 


£ = ’!'£ + £^'S = 


2Tii 2 L 11 L 12 
2 LJ 2 L 11 2 LJ 2 L 12 


Let X be the eigenvalue of £. We have 

xIm — ‘2L\i —2LiiLi2 
—2LJ2L11 X ~ 2.LJ2L12 
where / represents the identity matrix. 


Ix^M+i - £\ = 


Using 


A B 
C D 


| 2 l| • \D-CA-^B\, we have 


Ix-^M-I-I - £\ = \xIm - 2Tn| 

•lx - 2 LI 2 L 12 - 4Lf2Lii(x/M - 2L?i)-iPnTi2| • 

The eigenvalues of £ satisfying Ix^m — 2,L\i\ = 0 are 
all positive, because Tn and therefore are positive 
definite. Furthermore, x = 0 satisfies |x — 2 L 12 L 12 — 
4P^2Tii(x-^m — 2Tfj)“^PiiLi2| = 0. Additionally, it can 
be shown £1 m-i-i = £'^m+iA-£^'^1m+i = 0. Therefore, 

the proof of Lemma 2 can be concluded. □ 

Remark 2: It is worth noting that the Laplacian matrix 
dz for the undirected graph is only considered for the 
purpose of controller performance analysis. The actual 


distributed control topology is directed, since the leader 
is only sending the data and does not receive any data 
from other agents. 

The following result characterizes the stability and leader¬ 
following performance properties of the controlled system 
before fault occurrence. 

Theorem 1. In the absence of faults in the zth agent, the 
baseline controller described by (6) guarantees that the 
leader-follower consensus is achieved asymptotically with 
a time-varying reference state, i.e. a;^ — a;’’ —t 0 as t —t 00 . 

Proof. Based on (6) and before occurrence of the fault, 
the closed-loop system dynamics are given by 

Xip — ^ ^ kijXij -\~gip {rjip~\~ Kp^SgJli^ ^ ^ kijXij'^ , (9) 

j&N, j&Ni 

We can represent the collective state dynamics as 

xP = -£xP + C-C, (10) 

where xP € is comprised of the pth state component 

of the M + 1 agents, including the leader as the (M -|- 
l)th agent, i.e., xP = [a:ip, X 2 p, ■ ■ ■ , XMp, a;))] , the terms 
(P G and (p G 3?^+^ are defined as 

CP ^ [vip, ■■■ , PMp, 0]^, = [Cip, • • •, Cmp, 0]^, (11) 

where Qp = iVip + Kp)sgn{ J2jeNi , i = ,M. 

We consider the following Lyapunov function candidate: 

^ M ^ M 

Vp = xP ’^xP = - kijX^j + - fci(M+l)Ti(M-|-l)) 

i—1 jGNi i—1 

(12) 

where dz is defined in Lemma 2, ii(M-i-i) = Xip — X(^M+i)p: 
and X(^M+i)p is the pth component of the leader’s time- 
varying state x'^. Then, the time derivative of the Lya¬ 
punov function (12) along the solution of (10) is given by 

M 

Vp — xP £ xP -\~ 2Xp ^ {Xp Xip') 

i=l 

+2xp^^{e - cn, (13) 

where C is defined in (7). Based on (11), we have 

M 

xP'^'i'CP = X! X! %(^zp “ Xjp)p,p , (14) 

i—1 j^Ni 
M 

= ^ ^ k^jx^j{fj^p + Kp)sgn{ ^ kijXij). (15) 

i=l j^Ni j&Ni 

Using the property that kij = kji (based on Assump¬ 
tion 2), we know that Yliii EjezV; ktj{x,p-Xjp) = 
0. Therefore, we have 

M M 

‘^Xp ^ (a:^ Xip') = 2Xp ^ ^ ) kijXij. (16) 

i—1 i—1 jGNi 

By substituting (14), (15) and (16) into (13), we have 

M 

Vp = -xP'^£ xP A 2'^ y] kijXijCnip - Xp) 

i—1 j^Ni 



Based on (17) and Assumption 1, we have 



Vp < -xP'^CxP. 

Therefore, using Lemma 2, we know that Vp is negative 
definite with respect to Xip — Xjp, because the only x^ 
that makes —x^^Cx^ zero is = 1 m + ic , where c is a 
constant. Therefore, consensus is reached asymptotically, 
i.e., Xip—Xjp —)■ 0 as t —)■ oo. More specifically, Xip—Xp —>■ 0 
as t —>■ oo. □ 

5. DISTRIBUTED FAULT DIAGNOSIS 

The distributed fault detection and isolation (EDI) archi¬ 
tecture is comprised of M local EDI components, with one 
EDI component designed for each of the M agents. The 
objective of each local EDI component is to detect and 
isolate faults in the corresponding agent. Specifically, each 
local EDI component consists of a fault detection estimator 
(FDE) and a bank of Xi nonlinear adaptive fault isolation 
estimators (FIEs), where is the number of different 
nonlinear fault types in the fault set Ti (2) associated 
with the corresponding agent. Under normal conditions, 
each local FDE monitors the corresponding local agent to 
detect the occurrence of any fault. If a fault is detected 
in a particular agent i, then the corresponding local 
FIEs are activated for the purpose of determining the 
particular type of fault that has occurred in the agent. The 
EDI design for each agent follows the generalized observer 
scheme architectural framework (Blanke et al. (2006)). 
The distributed EDI algorithm is designed by extending 
the centralized algorithm in Zhang et al. (2004). 

5.1 Distributed Fault Detection 

Based on the agent model described by (1), the FDE for 
each agent is chosen as: 

Xi = (j)i{xt) + Ui + Hi{xi - Xi) , (18) 

where Xi € 3?” denote the estimated local state, Fli = 
diagjhii,-’' )^in} is a positive definite matrix, where 
—hip < 0 is the estimator pole, p = 1, - ■ ■ ,n, i = 1, ■ ■ ■ , M. 
Without loss of generality, let the observer gain be Hi = 
hiln where is a n x n identity matrix. It is worth 
noting that the distributed FDE (18) for the ith agent is 
constructed based on local input and state variables (i.e. 
Ui and Xi) and certain communicated information Xj from 
the FDE associated with the jth agent. 

For each local FDE, let Xi = Xi — Xi denote the state 
estimation error of the tth agent. Then, before fault 
occurrence (i.e., for 0 < t < Ti), by using (1) and (18), 
the estimation error dynamics are given by 

i* = -H^Xi +rii{xi,t). (19) 

The presence of modeling uncertainty rii{xi,t) causes a 
nonzero estimation error. A bounding function on the state 
estimation error Xip, before the occurrence of the fault 
can be derived. Specifically, based on Assumption 1, for 
0 < t < Ti, each component of the state estimation error 
Xip satisfies 

\S:ip\< [ fiipdr -\- Xipe~^^\ 

Jo 

where Xip is a conservative bound on the initial state 
estimation error (i.e., |iip(0)| < Xip). Therefore, for each 
component of the state estimation error (i.e., e^p = Xip — 
Xip), by using (19) and applying the triangle equality, we 
have \eip\ < Vip, where 


e + . (20) 

^0 

Note that the integral term in the above threshold can be 
easily implemented as the output of a linear filter with the 
input given by fiip{xi,t). 

Thus, we have the following: 

Fault Detection Decision Scheme: The decision on the 
occurrence of a fault (detection) in the tth agent is made 
when the modulus of at least one component of the state 
estimation error (i.e., eip{t)) generated by the local FDE 
exceeds its corresponding threshold i'ip{t) given by (20). 

The fault detection time Td is defined as the first time 
instant such that |eip| > Vip, for some Td > Ti and some 
p G {1, • • • ,n}, that is, 

n 

Td = inf |J{t > 0 : |e,p(t)| > Vip{t)} 

p=i 


5.2 Distributed Fault Isolation 

Now, assume that a fault is detected in the tth agent at 
some time Td; accordingly, at t = Td the FIEs in the local 
EDI component designed for the ith agent are activated. 
Each local FIE is designed based on the functional struc¬ 
ture of one potential fault type in the agent (see (3)). 
Specifically, the following nonlinear adaptive estimators 
are designed as isolation estimators: for s = I, • • • , , 

xt = Mxi) + U, + A‘^{x, - xO + f-ixi,u„9‘) 
nixi,Ui,9^,) = [(0(*i)^p®i(a;i,M*),- - • , gt„ix^,u0f , 

( 21 ) 

where 9f, for t = I,-- - , M, and s = I,-- - ,ri, is the 
estimate of the fault parameter vector in the tth agent, 
Af is a diagonal positive definite matrix. For notational 
simplicity and without loss of generality, in this paper we 
assume that Af = Xi for all s = 1, • • • , r^. 

The adaptation in the isolation estimators is due to the 
unknown fault parameter vector 9f. The adaptive law 

for updating each 9f is derived by using the Lyapunov 
synthesis approach (loannou and Sun (1996)), with the 
projection operator restricting 9f to the corresponding 
known set 0f. Specifically, if we let efp(t) = Xip — x^p, 
p = 1, • • • , n, be the pth component of the state estimation 
error generated by the sth FIE associated with the tth 
agent, then the following adaptive algorithm is chosen: 

kp = 'Pet^{ltp9ip{xi,Ui)e‘lp} , 

where 7®, > 0 is a constant learning rate. 

Based on (1) and (21), each component of the state 
estimation error dynamics in the presence of fault s is given 

by 

Xip = ~^iXip + Vip{Xi, t) — iPip) 9ip{Xi, Ui) , 

where, for p = 1, • • • ,n, i®, is the state estimation error, 
9fp = 9fp—9fp is the parameter estimation error. Therefore, 
by using the triangle equality, a bound on each component 
of the state estimation error can be obtained as 



IXipl < 


f e Vtpixi,T)+^tp\9tpixi,u^)\ dr 

JTi I J 


+Xipe 


-\i{t-Td) 


where xL is a conservative bound on the initial state 
estimation error (i.e., \xlj^{Td)\ < xfp), and represents 
the maximum fault parameter vector estimation error, 
i.e., \6fp - 0|p(t)| < ^Ip. The form of ^|p depends on the 
geometric properties of the compact set <dfp (Zhang et al. 
(2004)). For instance, assume that the parameter set 
is a hypersphere (or the smallest hypersphere containing 
the set of all possible 0fp{t) with center 0|p and radius 
Rfp); then we have ^fp = R'lp + \0fpit) - Ofp\. 

Therefore, each component of the state estimation error 
P = 1. • • • , n, satisfies |efp| < nfp, where 

PipW= / fjip{xi,T)+^^p\gtpixi,u^)\ dr 

JTa L J 

+xlpe-^'^^-'^’^K (22) 

The fault isolation decision scheme is based on the fol¬ 
lowing intuitive principle: if fault s occurs at some time 
Ti and is detected at time then a set of threshold 
functions ^fp(t) can be designed such that each compo¬ 
nent of the state estimation error generated by the sth 
estimator satisfies |efp(t)| < Aifp(0 ^ ^ '^d- In the 

fault isolation procedure, if for a particular fault isolation 
estimator 5, there exists some p G {I,-’’ jn}, such that 
the pth component of its state estimation error satisfies 
kip (01 > Pip(0 loi" some finite time t > Td, then the 
possibility of the occurrence of corresponding fault type 
can be excluded. Based on this intuitive idea, the following 
fault isolation decision scheme is devised. 

Distributed fault isolation decision scheme: If for each 
b G {I,-" )?'i}\{s}) there exist some finite time t^ > Td 
and some p G {1, • • • , n}, such that |e*'(t*')| > p('p(0), then 
the occurrence of fault s in the ith subsystem is concluded. 

6. FAULT-TOLERANT CONTROLLER MODULE 

In this section, the design and analysis of the ETC schemes 
are rigorously investigated for two different operating 
modes of the closed-loop system: 1) during the period 
after fault detection and before isolation, and 2) after 
fault isolation. To facilitate the analysis of the distributed 
adaptive FTC systems, from now on we assume that the 
general fault function ff{xi,Ui) given in (3) takes on the 
following specific forms: 

(1) Process faults represented by 

ft(xi) = [{0tif gtiixi), ■■■ , {Otnf gtnixi)]^ , (23) 

(2) Actuator fault represented by partial loss of effective¬ 
ness of the actuators. Specifically, 

//(«,)= KW,-- - , (24) 


where the parameter 0|, 


(-1,0], p = 1, 


characterizes the magnitude of the actuator fault. 

6.1 Aecommodation before Fault Isolation 

After the fault is detected at time t = Td, the isola¬ 
tion estimators are activated to determine the particular 
type of fault that has occurred. Meanwhile, the nominal 


controller is reconfigured to ensure the system stability 
and some tracking performance after fault detection. In 
the following, we describe the design of the fault-tolerant 
controller using adaptive tracking techniques. Before the 
fault is isolated, no information about the fault type and 
fault function is available. Adaptive approximators such 
as neural-network models can be used to estimate the 
unknown process fault function /?i/i. The term “adaptive 
approximator” (Farrell and Polycarpou (2006)) is used 
to represent nonlinear multivariable approximation mod¬ 
els with adjustable parameters, such as neural networks, 
fuzzy logic networks, polynomials, spline functions, etc. 
Specifically, we consider linearly parametrized network 
(e.g., radial-basis-function networks with fixed centers and 
variances) described as follows: for p = 1, • • • ,n, 

e 

fip{.Xi,‘dip) — ^ j Tj jxj ), (25) 

i=i 

where Pj{-) represents the fixed basis functions, and Dip = 
col{cpj : j = I,-- - ,g) is the adjustable weights of the 
nonlinear approximator. In the presence of a process fault, 
fip provides the adaptive structure for online approximat¬ 
ing the unknown fault function fip{xi). This is achieved 
by adapting the weight vector Dip{t). Therefore, the sys¬ 
tem dynamics described by (1) can be rewritten as, for 
p= I,--- ,n, 

Xip — 4^ip{Xip) -f (1 -f 0ip)Uip -f TJip -j- fip{Xi, Dip) -\- SipiXi), 

(26) 

where the parameter 9ip is defined in (24), dip = fip{xi) — 
fip{xi, Dip) is the network approximation error for the pth 
state of the fth agent, and Dip is the optimal weight vector 
given by 


Dip = arg inf sup \fip{x^) - ftp{x^,Dip)\ > , 

DipeSip IxiGXi J 

where Xi C 3?” denotes the set to which the variables 
Xi belongs for all possible modes of behavior of the 
controlled system. To simplify the subsequent analysis, 
in the following we assume that the bounding conditions 
on the network approximation error are global, so we 
set Xi = 3?". For each network, we make the following 
assumption on the network approximation error: 

Assumption 3. for each i = 1, - ■ ■ , M, and p = 1, • • • , n, 
kzpl ^ i^ipdipiXi) , (2f) 

where dip is a known positive bounding function, and aip 
is an unknown constant. 

Based on the system model (26), the neural network model 
(25), and Assumption 3, an adaptive neural controller can 
be designed using adaptive approximation and bounding 
control techniques (Farrell and Polycarpou (2006)). Specif¬ 
ically, we consider the following controller algorithm: 


'— f^ipiXip) ^ ( i^ijXij') fip{Xi,Dip{f)) 


-{r]ip + Kp)sgni ^ hjXij j , 

V AT. / 


Dip — ^ ( kijXij(pip(^Xi ), 

j&N, 


( 30 ) 



'ipip = aipdip{xi)sgni hjXijj , (31) 

^jeNi ^ 

OLip — ^ip I ^ ( kijXij^ '^ip{Xi') , 

j&Ni 

Oip — ^9ip \ ^ip ^ ^ kijXijUip / , (^3) 

^ jeNi ' 

where are positive constants, Oip is an estimation 
of the actuator fault magnitude parameter Oip with the 
projection operator V restricting Oip to the corresponding 
set [ 0 ip,O] for Oip G (— 1 , 0 ), 'dip is an estimation of the 

neural network parameter vector 'dip, ip ip = coUppj : j = 
1 , • • • ,g) is the collective vector of fixed basis functions, 
cxip is an estimation of the unknown constants aip, and 
Tip and Tip are symmetric positive definite learning rate 
matrices. 

Using some algebraic manipulations, we can rewrite (28) 
as Uip = Uip — OipUip. Therefore, using (26) and (28), we 
can represent the collective closed-loop state dynamics as 
xP = -CxP + C-C + F+ SP-^P+ wP , (34) 

where xP G 3?^+^, p = I,-- - ,n, is comprised of the 
pth component of the M agents and the leader as the 
(M -I- l)th agent, i.e., xP = [xip, X 2 p, • • • , XMp, 
terms (p G and F € are defined in (11), 

and the terms fP G 3?^+^, Sp G 3?^+^, iI^p G and 

hjP G 3?^“''^ are defined as 


respectively, it can be shown that the time derivative of the 
Lyapunov function (39) along the solution of (34) satisfies 

Vp<-xP^CxP 



It is worth noting that since the projection modification 
can only make the Lyapunov function derivative more 
negative, the stability properties derived for the standard 
algorithm still hold (Farrell and Polycarpou (2006)). By 
using (31) and based on Assumption 3, we have 

^ ^ kijXij{6ip ‘ipip) 
j&Ni 

^ ^ ^ij^ij (^dip cXipSipSgni^ ^ ^ kijXij^'j 
j&Ni j&Ni 

— I ^ ^ kijXij\oiipSip. (40) 

j&Ni 

By Using (40), we have 


M 


Vp<-xP^ CxP 






C^ip^ip 


i—l ^ jGNi 
^ipi^ip^ ■ 

Therefore, by using (32) and after some algebraic manip¬ 
ulations, we have 


F = [{Kfcip ■ ■ ■ i^MpfpMp o]^ , (35) 

^ [Jip ... 6mp 0]^ , (36) 

F = [Fp • • • ^Mp of , (37) 

^ * * * 0Mp'^Mp O] 1 (^^) 

where Oip = Oip — Oip is the actuator fault magnitude 
estimation error, and 'dip = dip — 'dip and ip ip are the pa¬ 
rameter estimation errors and basis functions correspond¬ 
ing to the neural network model associated with the pth 
state component of the zth agent, respectively. To derive 
the adaptive algorithm and to investigate analytically the 
stability properties of the feedback system, we consider the 
following Lyapunov function candidate: 

Vp = xP^-^ xP + {dPf{TP)-^F + {aPf(TP)-^aP 

+ {ePf{fP)-FP, (39) 

where is defined in Lemma 2, F = [dfp, • • • , dfp] 
is the collective parameter estimation errors, dP = 
[dip, ... , aMpf is the collective bounding parameter 
estimation errors defined as dip = aip — dip, OP = 

[Oip, • • • , Omp] ^ is the collective actuator fault magnitude 
parameter estimation errors, and T^ = diagjTip,... , Tmp}, 
TP = diag{Tip,... ,Tmp} and = diagjfip,... ,fMp} 
are adaptive learning rate matrices. 

Following the same procedure as given in the proof of 
Theorem 1, using (35), (36), (37) and (38), and selecting 
the adaptive algorithm for 'dip and Oip as (30) and (33), 


Up < -xP'^C xP = 




(41) 


Based on the same reasoning logic as reported in the 
proof of Theorem 1, we conclude that Vp is negative 
semidefinite, and Xip — Xjp, 'dip and dip are uniformly 
bounded. Integrating both sides of (41), we know that 
{xip — Xjp) G L 2 . Since {xip — xjp) G Loo H L 2 and 
Xip — Xjp G Loo, based on Barbalat’s Lemma, we can 
conclude that consensus is reached asymptotically, i.e., 
Xip — Xjp —)■ 0 as t —)■ 00 . More specifically, Xip — Xp ^ 0 
as t —>■ 00 and therefore, the leader-follower consensus is 
reached asymptotically. 


The aforementioned design and analysis procedure is sum¬ 
marized as follows: 

Theorem 2. Suppose that the bounding Assumption 3 
holds. Then, if a fault is detected, the adaptive fault- 
tolerant law (28), the weight parameter adaptive law (30), 
the bounding parameter adaptive laws (31) and (32), and 
the actuator fault parameter adaptive law (33) guarantee 


( 1 ) all the signals and parameter estimates are uniformly 
bounded, i.e., Xip, 'dip and dip are bounded for all 
t G {Ti, Tisoi)', 

( 2 ) leader-follower consensus is achieved asymptotically 
with a time-varying reference state, i.e. Xi — x^ ^ 0 
as t —>■ 00 . 


6.2 Aceommodation after Fault Isolation 

Let us now assume that the isolation procedure described 
in Section 5 provides the information that fault s has 
been isolated at time Tisoi ■ Based on the FTC architecture 



described by (5), the controller is reconfigured again to 
further improve control performance based on the diagnos¬ 
tic information of isolated fault type. Below, we describe 
the cases of process fault described by (23) and actuator 
fault given by (24), respectively. Without loss of generality, 
let the leader be the agent number M + \ with a set of 
neighborhoods Nm+i- 

Adaptive Fault-Tolerant Controller for Process Fault 

After the isolation of the fault type s, i.e., t > Tisoi, the 
dynamics of the system takes on the following form: for 
p =!,■■■ ,n, 

'^ip F rjip{xi^t^ F ^ip9ipi.^i^ ■ (^^) 

The following adaptive fault-tolerant controller is adopted: 

Uip =—(f>ip{Xip) — ^ ( {kijXij^ ~^ip9ip{Xi) 
jeNi 

-{fjipF Kp)sgni (43) 

^ip = Tip ^ ) kijXijPip^Xi ), (44) 

jeNi 

where Otp is an estimation of the unknown fault parameter 
vector, and Tip is a symmetric positive definite learning 
rate matrix. Then, we have the following: 

Theorem 3. Assume that process fault s occurs at time 
and that it is isolated at time Tig^i. Then, the fault-tolerant 
controller (43) and fault parameter adaptive law (44) 
guarantee that the leader-follower consensus is achieved 
asymptotically with a time-varying reference state, i.e., 
Xi — x’’ —)■ 0 as t —)■ oo. 

Proof. Based on (42) and (43), the closed-loop system 
dynamics are given by 

Xip = ^ ^ i^ijXij') F rfipi^Xij f) F dip gipixip') 

j&N, 

-{rjip F Kp)sgni kjjXjj 
We can represent the collective output dynamics as 

xP = -CxP FfP-CF fP (45) 

where xP G p = I,-- - ,n, is comprised of the 

pth component of the M agents and the leader as the 
(M -I- l)th agent, i.e., xP = [xip, X 2 p, ■■■ , XMp, Xp]^, the 
terms (p G and (p G are defined in (11), 

/®P G is defined as 

r^=[fip,---,fMp,Or (46) 

where = {9tpYgfp, t = 1 , • • • , M, and dip = d*p - d^p 
and g'ip are the parameter estimation error and fault func¬ 
tions corresponding to the pth component of M agents, 
respectively. We consider the following Lyapunov function 
candidate: 


Vp = xP^'TxP FdP'^{TP)-^dP, (47) 

where 4' is defined in Lemma 2, dP = [0^, • • • , djpp]'^ 
is the collective parameter estimation errors, and T^ = 
diagjTip, • • • , Lmp} is a positive definite adaptive learning 
rate matrix. Then, using (14), (15), and the same reasoning 


logic for (46), the time derivative of the Lyapunov function 

(47) along the solution of (45) is given by 

M 

Vp = -xP^L xP F 2 '^ ^ kijXij {pip - Xp) 

i—1 j^Ni 
M 

- 2 ^ ^ kijX^j{fj^pF Kp)sgn{ ^ kijXij) 

i—lj^Ni j^Ni 

F‘2 'y ' djp ( 'y ) kijXijgip — (Tip) dip 

i=i ^jeNi 

where C is defined in (7). Therefore, choosing the adaptive 
law as (44), we have Vp < —xP^’^CxP. Then, the proof can 
be concluded by using the same reasoning logic as reported 
in the analysis of Theorem 2. □ 

Adaptive Fault-Tolerant Controller for Actuator Fault 

In the case of an actuator fault, i.e., t > Tisoi, the dynamics 
of the system takes on the following form: for p = 1, • • • , n, 
Xip — 4*ip{xip) T (1 -f dip)uip F rjip{xij t) . (48) 

The following adaptive fault-tolerant controller is adopted: 

Uip = “ ^ Uip , ( 49 ) 

lFd,p 

dip —\ Tip y ( kijXijUip / , (hO) 

^ jeNi ' 

where Uip = -(fipixip) - ^ - RipSgn{ ^ kijXij), 

j&N, j&N, 

dip is an estimation of the unknown actuator fault magni¬ 
tude parameter dip with the projection operator V restrict¬ 
ing dip to the corresponding set [Rip,0] for dip G (—1,0), 
and Tip is a symmetric positive definite learning rate 
matrix. Then, we have the following: 

Theorem 4- Assume that an actuator fault occurs at 
time Ti and that it is isolated at time Tisoi- Then, the 
fault-tolerant controller (49) and fault parameter adap¬ 
tive law (50) guarantee that the leader-follower consensus 
is achieved asymptotically with a time-varying reference 
state, i.e., Xi — x’’ —>■ 0 as t —>■ 00 ; 

Proof. Using some algebraic manipulations, we can rewrite 
(49) as Uip = Uip — dipUip. Therefore, substituting Uip in 

(48) , the closed-loop system dynamics are given by 


Xip — 


y ^ iJ^ijXij) F rjip^Xi, t) F dipUip 

j&Ni 



We can represent the collective output dynamics as 


xP = -CxP FC.P-C,PFwP (51) 

where xP G p = 1 , • • • , n, is comprised of the pth 

component of the M agents and the leader as the (M-l-l)th 
agent, i.e., xP = [xip, X 2 p, ■ ■■ , XMp, x^f) , and the terms 
(P G (P G and wP G are defined in 

(11) and (38). 

We consider the following Lyapunov function candidate: 



Vp = , (52) 

where 'I' is defined in Lemma 2, 9^ = \9ip, ••• , 0Mp]^ 
is the collective actuator fault magnitude parameter esti¬ 
mation errors, and = diagjrip, • • • , Lmp} is a positive 
definite adaptive learning rate matrix. Then, using (14) 
and (15), and the same reasoning logic for (38), the time 
derivative of the Lyapunov function (52) along the solution 
of (51) is given by 

M 

Vp = -x'P'^C xP -h 2 ^ ^ kijXij {T]ip - ijp) 
i=l j&N, 

-f2 ^ ( 9ip f ^ ) kijXijUip (r^p) 9ip j 

M 

2 ^^ ^ ( kijXiji^fJip Kp')SgTl(^ ^ ^ kijXij'^ , 
i=l j^Ni j&Ni 

where C is defined in (7). Therefore, choosing the adaptive 
law as (50), we have Vp < —x^^Lx^. Then, the proof can 
be concluded by using the same reasoning logic as reported 
in the analysis of Theorem 2. □ 

7. SIMULATION RESULTS 

In this section, a simulation example of a networked 
multi-agent system consisting of 5 agents is considered to 
illustrate the effectiveness of the distributed fault-tolerant 
control method. The dynamics of each agent is given by 

Xi=Ui+'qi +l3i(t-Ti)fi{xi,Ui), (53) 

where, for i = I,-- - ,5, Xi = \xii,Xi 2 Y^ and Ui = 
\viCos{'4)i),ViSin{'il)i)Y are the state and input vector of 
tth agent, respectively, -ipi and Vi in the input vector Ui 
are the orientation and the linear velocity of each agent 
representing a ground vehicle. 

The ground vehicle given model in (53) is a standard 
unicycle-like model that can be controlled with the orienta¬ 
tion ipi and vehicle linear velocity Vi. Using the developed 
algorithms, the desired orientation and linear velocity of 
the ground vehicle robot can be obtained uniquely. Then, 
a low level controller can be designed to track the desired 
orientation and linear velocity for driving the ground ve¬ 
hicles to desired positions. 

The unknown modeling uncertainty in the local dynamics 
of the agents are assumed to be sinusoidal signals r]i = 
[0.5sm(t), 0.5sm(t)]^ bounded by fji = [0.6,0.6]^. The 
objective is for each agent to follow the leader’s position 
described by x'^ = \x\, = [5 -I- sin{t),5 + cos(t)]^. 

The Laplacian matrix of the intercommunication graph of 
agents plus leader is given as 

-2-1 0 0-1 0- 

-1 3 0 0-1-1 

^ ^ 0 0 2 -1 -1 0 
0 0-12-10' 

-1 -1 -1-1 4 0 

L 0 0 0 0 0 oJ 

The fault class under consideration is defined as follows 

(1) A process fault described by // = 9jgj, where gj = 
x‘fcos{xi) and the fault magnitude 9l € [0,1]. 

(2) An actuator fault described by ff = 9‘fgf, where 
gf = Ui and the fault magnitude 9^ G [—0.8, 0]. 


The observer gain for fault detection estimator is chosen 
as hi = 2. For fault isolation estimator \i = 10 has been 
chosen. Based on the magnitude of the fault types, we 
choose the center and radius of the parameter projection 
sphere as O] = 0.5 and R] = 0.5 for the process fault type 
and Of = —0.4 and R\ = 0.4 for the actuator fault type, 
respectively. 

A radial basis function (RBF) neural network is used for 
approximation of the process fault function after its detec¬ 
tion and before its isolation. The RBF network considered 
in this paper consists of 21 neurons with 21 adjustable 
gain parameters. The center of radial basis functions are 
equally distributed on interval [—10,10] with a variance of 
0.5. The initial parameter vector of the neural network is 
set to zero. We set the learning rate as Tj = 5 and consider 
a constant bound on the network approximation error, i.e., 
5i = 1. The adaptive gains in (32) and (33) are chosen as 
Ti = 2 and fi = 1, respectively. 

After fault isolation, the controller is reconfigured to 
accommodate the specific fault that has been isolated. We 
set the adaptive gain T^ = 0.2 with a zero initial condition 
(see (44)). 

Figure 1 and Figure 2 show the fault detection and 
isolation results when the first process fault class (i.e., 
/i = with a magnitude of 0.8 occurs to agent 1 at 

Ti = 5 second. As can be seen from Figure 1, the residual 
corresponding to the output generated by the local FDE 
designed for agent 1 exceeds its threshold immediately 
after fault occurrence. Therefore, the process fault in agent 
1 is timely detected. It can be seen in Figure 2 that 
the residual corresponding to the FIE associated with the 
first fault type always remains below the threshold, while 
the residual corresponding with the FIE associated with 
the second fault type exceeds the threshold immediately 
after fault occurrence. Thus, based on the fault isolation 
decision scheme described in section 5.2, the occurrence of 
fault type 1 can be concluded. The fault diagnosis results 
for the second states have the same behavior and therefore 
are omitted. 

In Figure 3 and Figure 4 we compare the leader-following 
performance of the agents under the action of the pro¬ 
posed adaptive FTCs. Regarding the performance of the 
adaptive fault-tolerant controllers, as can be seen from 
Figure 3, the leader-following consensus is achieved using 
the proposed adaptive FTCs, while the agents cannot 
follow the leader without the FTC controllers after fault 
occurrence (see Figure 4). Thus the benefits of the FTC 
method can be clearly seen. 

8. CONCLUSION 

In this paper, we investigate the problem of a distributed 
FTC for a class of multi-agent uncertain systems. Under 
certain assumptions, adaptive FTC controllers are devel¬ 
oped to achieve the leader-following consensus in the pres¬ 
ence of faults. The extensions to systems with more general 
structure is an interesting topic for future researches. 
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